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Abstract.  We  extend  the  ideas  introduced  in  [TNV04]  for  hierarchical  multiscale  decompo¬ 
sitions  of  images.  Viewed  as  a  function  /  €  a  given  image  is  hierarchically  decomposed 

into  the  sum  or  product  of  simpler  “atoms”  u*,,  where  Uk  extracts  a  more  refined  informa¬ 
tion  from  the  previous  scale  Uk-i .  To  this  end,  the  Uk  s  are  obtained  as  dyadically  scaled 
minimizers  of  standard  functionals  arising  in  image  analysis.  Thus,  starting  with  u_i  :=  f 
and  letting  Vk  denote  the  residual  at  a  given  dyadic  scale,  A k  ~  2fe,  then  the  recursive  step 
[uk,Vk\  —  arginfQr{vk-i,  Xk)  leads  to  the  desired  hierarchical  decomposition,  /  ~  Tuk ; 
here  T  is  a  blurring  operator.  We  characterize  such  Q^-minimizers  (by  duality)  and  expand 
our  previous  energy  estimates  of  the  data  f  in  terms  of  ||itfc||.  Numerical  results  illustrate 
applications  of  the  new  hierarchical  multiscale  decomposition  for  blurry  images,  images  with 
additive  and  multiplicative  noise  and  image  segmentation. 
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1.  Introduction 

We  continue  our  study  of  the  hierarchical  image  decomposition  method  introduced  by  the 
authors  in  [TNV04]  (hereafter  abbreviated  TNV).  We  extend  the  hierarchical  decomposition 
method  to  the  case  of  functionals  arising  in  image  deblurring,  in  multiplicative  image  denoising, 
and  in  image  segmentation.  Convergence  results  and  energy  estimates  are  given,  together  with 
experimental  results  on  real  images. 
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1.1.  Hierarchical  (. X ,  Y )  decompositions.  We  begin  with  a  pair  of  normed  function  spaces, 
(. X ,  ||  ■  ||x)  and  (Y,  ||  ■  ||y),  and  their  associated  Q-functional, 

(1.1)  Q(f,  A)  :=  Q(f,  A;  X,  Y)  :=  inf  { \\u\\x  +  A|| /  -  u\$}}  A  >  0. 

We  will  talk  about  functions  in  the  smaller  space  X  being  “smoother”  than  those  in  Y ,  so  that 
the  condition  ||u||x  <  oo  can  be  viewed  as  a  regularizing  constraint.  The  use  of  regularized 
Q-like  functionals  has  a  long  history  starting  with  the  classical  Tikhonov-type  regularizations, 
consult  [TA77,  Mo84,  Mo93] .  They  can  be  found  in  a  variety  of  applications;  we  mention  here 
two:  the  work  on  support  vector  regression,  e.g.,  [Va98],  and  the  early  works  in  the  context  of 
image  processing  [GG84,  AV94,  R094,  GS00,  GS00].  In  these  works,  A  is  treated  as  a  fixed 
threshold  parameter.  The  Q-functional  (1.1)  is  also  closely  related  to  the  standard  /7-functional 
which  arises  in  interpolation  theory,  e.g.,  [BL76,  BS88,  DL93,  Kr07], 

K{f,  A;  X,  Y)  :=  inf  { \\u\\x  +  A|| /  -  u\\Y},  A  >  0. 

uex  i  ) 

The  relation  between  the  Q-  and  the  K -functionals  is  summarized  in 

Q(f,  py,  X,  Y)  «  K(f,  A;  X,  Y),  ,iA  :=  — . 

In  this  context  of  K -functionals,  however,  A  does  not  just  serve  as  a  threshold  parameter,  but  in 
fact  is  treated  as  a  variable:  the  collection  of  /’ s  with  prescribed  behavior  of  K(f,  A)  as  A  j  oo, 
forms  intermediate  interpolation  smoothness  spaces*.  This  is  the  point  of  view  we  adopt  in  the 
hierarchical  decomposition  of  Q-functionals  described  below,  with  A  being  treated  as  a  scaling 
variable. 

We  assume  that  the  minimization  problem  has  a  solution  u  :=  ux,  and  we  let  vx  denote  the 
residual,  vx  :=  f  —  ux.  This  will  be  expressed  as 


(1.2a)  f  =  ux+  vx,  [ux,  vx\  =  arginf  Q(f,  A;  X,  Y). 

U+V=f 

In  general,  ||w||.y  will  be  a  regularizing  term,  thus  ux  will  contain  only  the  “larger”  features  of 
/,  while  the  residual  vx  will  contain  the  “smaller”  features.  Of  course,  the  distinction  between 
these  two  components  is  scale  dependent  -  whatever  is  interpreted  as  ‘small’  features  at  a  given 
A-scale,  may  contain  significant  features  when  viewed  under  a  refined  scale,  say  2A, 

(l-2b)  vx  =  u2X  +  v2X,  [u2 a,  v2X]  =  arginf  Q(vx,  2A). 

U-\-V=V\ 

By  combining  (1.2a)  with  (1.2b)  we  arrive  at  a  better  two-scale  representation  of  /  given  by 
/  ~  +  u2X.  Features  below  scale  1/2A  remain  unresolved  in  v2X  but,  the  process  (1.2b)  can 

be  continued.  Starting  with  an  initial  scale  A  =  Aq, 


(1.3a) 


f  =  u0  + Vo,  [u0,  u0]  =  arginf  Q(f,  A0), 

u-\-v=f 


*  Observe  that  the  definition  of  the  A'- functiona  l  here  exchanges  the  usual  ordering  between  X  and  Y,  so  that 
it  scales  with  increasing  A,  in  order  to  keep  the  compatability  with  the  usual  use  of  the  scaling  of  Q-functional 
in  image  processing. 
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a  more  refined  decomposition  of  /  into  simpler  “atoms”  is  obtained  by  successive  application 
of  the  dyadic  refinement  step  (1.2b), 

(1.3b)  vj  =  uj+i  +  vj+1,  [uj+ i,vj+1]  :  =  arginf  Q(vjt  A02J+1;  A",  Y),  j  =  0, 1, .... 

U-\-V=Vj 

After  k  such  steps,  we  end  up  with  the  following  hierarchical  decomposition  of  / 

/  =  Uq  +  Vo  = 

=  U0  +  U1+  V\  = 


(1.4)  =  Mo  +  Ml  H - b  uk  +  vk. 

The  above  multiscale  expansion  provides  a  new  hierarchical  representation  of  the  data  /, 

OO 

(1.5)  f=J2uJ> 

j= o 

where  the  approximate  equality  =  in  (1.5)  should  be  interpreted  as  the  convergence  of  the 
residuals  vks  in  (1.4)  to  be  made  precise  below.  The  partial  sum,  J^=0Wj,  provides  a  multi¬ 
layered  description  of  /  which  lies  in  an  intermediate  scale  of  spaces,  in  between  X  and  Y, 
though  the  precise  regularity  may  vary,  depending  on  the  scales  which  are  present  in  /. 

Remark  1.1.  [The  homogeneity  of  the  hierarchical  decomposition].  We  note  here  the  anomaly 
of  the  Q-functional  (1.1):  when  an  image  /  with  minimizer  [m,  v]  doubles  its  intensity,  2/,  its 
minimizer  does  not  scale  accordingly  since  the  quadratic-based  Q  is  not  homogeneous.  This 
anomaly  of  the  Q-functionals  is  fixed  by  their  hierarchical  decompositions.  To  this  end,  we 
observe  that  if  [mo,mo]  is  the  minimizing  pair  of  Q(/,  A)  then  [2mo,2mo]  is  the  minimizer  of 
Q(2/,  A/2).  Consequently,  if  an  image  /  has  the  hierarchical  description  (1.3b),  /=  Ylp=ouj-> 
then  we  find  recursively, 

2 vj  =  2ui+i  +  2vj+i,  [2uj+i,  2vj+i\  :=  arg  inf  Q(vj,  A02J;  X,  Y),  j  =  0, 1, .... 

u-\-v=2vj 

We  conclude  that  the  hierarchical  decomposition  is  homogeneous  of  degree  one:  when  doubling 

OO 

the  intensity,  2/  has  the  corresponding  hierarchical  decomposition  2 /s  2uj . 

3=0 

1.2.  Hierarchical  (BV,  L2)  decomposition.  As  a  prototype  example,  we  discuss  the  hier¬ 
archical  (BV,  L2)  decomposition  introduced  in  TNV.  A  special  case  of  Tikhonov  regulariza¬ 
tion  with  (X,  Y)  =  (BV(Q),  L2(Q))  is  the  Rudin-Osher-Fatemi  Total  Variation  (TV)  func¬ 
tional*.  It  was  advocated  by  Rudin,  Osher  and  Fatcmi  [ROF92]  who  proposed  the  func¬ 
tional,  Q(f,  A ,  BV (tt) ,  L2 (ft)) ,  to  recover  a  sharp  image  u  from  its  noisy  version  f  —  u  +  v, 
prescribed  over  an  open  bounded  domain  C  IR2.  Here,  ||/  —  u\\2l2^  is  a  fidelity  term, 
Mw(f2)  :=  ./  \Du\  =  1 1 m 1 1 (q)  is  a  regularizing  term  preserving  edges,  and  A  >  0  is  a  threshold 
parameter  which  measures  their  relative  weight.  For  /  e  L2(H),  the  problem  admits  a  unique 
minimizer  u  :=  U\  (consult  [AV94],  [CL97],  or  [VeOl]  for  a  more  general  regularizing  term), 
which  decomposes  an  L2(fl)-image,  /,  into  two  distinct  components, 

(1.6)  /  =  ma  +  ma,  [ma,ma]  =  arginf  Q(f,  A;  BV (Q) ,  L2 (Q)) . 

U+V=f 


TV  should  not  be  confused  with  TNV. 
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This  TV-based  model  is  a  very  effective  tool  in  denoising  images  while  preserving  edges 
provided  apriori  information  on  the  noise  scaling,  A,  is  known.  Otherwise,  if  Q(f,  A)  is  being 
implemented  with  a  too  small  A,  then  only  a  cartoon  representation  of  /  is  kept  in  the  form 
of  u\  G  BV{fl ),  while  small  textured  patterns  or  oscillatory  details  are  swept  into  the  residual 
V\  :=  f  —  u\.  If,  on  the  other  hand,  A  is  kept  too  large,  then  u\  remains  loaded  with  too 
many  details  which  is  close  to  the  original  /;  not  much  change  has  been  applied  to  /  and 
the  compression  ratio  is  small.  In  some  cases,  e.g.,  [ROF92,  CL97],  the  parameter  A  can  be 
estimated  if  some  statistical  information  on  the  noise  is  known,  but  in  general,  this  setup  is 
limited  by  the  use  of  the  one  scale  dictated  by  A.  The  corresponding  (BV,  L2)-hierarchical 
decomposition  introduced  by  the  authors  in  [TNV04], 


(1.7)  /=£>;>  UjeB  V(n), 

3 

is  independent  of  apriori  parameters  and  is  particularly  suitable  for  image  representations.  The 
resulting  multi-layered  expansion,  /  ~  J2juj,  is  essentially  nonlinear  in  the  sense  that  its 
dyadic  blocks,  Uj,  depend  on  the  data  itself,  Uj  =  Uj(f).  The  dyadic  blocks  capture  different 
layers  of  scales  of  the  original  image.  Their  precise  multiscale  nature  is  quantified  in  the  energy 
decomposition  derived  in  TNV, 


ll/ll 


2 

L2(  Q) 


3=0 


-A? 


Multi-layered  representations  of  images  are  not  new.  We  mention  here  those  based  on  wavelet 
expansions,  e.g.,  [MAC02],  [ACMS98],  and  the  TV  based  expansion  suggested  by  Rudin  and 
Casellcs  in  [RC].  The  hierarchical,  multi-layered  (BV,  L2  ^decompositions  (1.7)  were  found  to 
be  an  effective  tool  in  image  processing,  [TNV04,  BCM05]  and  image  registration  [LPSX06, 
PL07].  They  can  be  extended  to  application  of  image  denoising  in  the  presence  of  additive  or 
multiplicative  noise,  to  image  deblurring  or  to  image  segmentation.  These  will  be  discussed  in 
the  sections  below. 


2.  Hierarchical  decomposition  of  blurry  and  noisy  images 

We  are  given  a  blurred  image,  represented  by  /  G  L2(£2);  blurring  will  be  modeled  by  a 
linear,  continuous  blurring  operator,  T  :  L2(Vt)  — >  L2(H)  (such  as  a  convolution  with  a  Gaussian 
kernel).  We  consider  a  decomposition  of  /  provided  by  the  following  Qr(f,  A)  minimization  in 
the  presence  of  blur, 

(2.1a)  ST(/,A;A'(f!),L2(f!))  :=  inf  { |M|  +  A||/ - T«|||J(n)}. 

Here,  the  regularization  functional  ||  ■  ||  :  X  C  BV(Q)  —a  [0,  oo]  is  a  semi-norm  which  takes  a 
general  form, 

(2.1b)  \\u\\  =  |ML  :=  /  <f(Dpu ),  p  >  1. 

Jn 

Few  examples  for  such  regularizing  functionals  are  in  order.  If  ||u||  =  \u\bv(Q)  —  Jq  Du 
is  the  total  variation  of  u,  then  (2.1a)  becomes  the  denoising-deblurring  model  introduced  in 
[ROF92,  R094],  A  more  general  BV-type  model  is  provided  by  ||w||  =  fnf>(\Du\)  with  a 
proper  norm,  defined  on  the  space  of  measures;  the  corresponding  QT  in(2.1a)  then  becomes 
the  generalized  BV  model  studied  in  [DT84,  VeOl,  EO04],  Other  examples,  defined  on  dense 
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subspaces  of  BV,  are  provided  by  ||w||  =  H-DmIIl2^)  :  H 1(f])  — >  [0,  oo),  or  the  second-order 
IMI2  =  In  \D2u\  :  BH{VL)  — >  [0, 00)  defined  on  BH,  the  space  of  functions  with  bounded 
Hessian. 

Let  v\  f  —  Tu\  denote  the  ‘texture’  at  scale  A  associated  with  the  blurring  model  (2.1a), 

[u\,vx]  =  arginf  QT(f,  A). 

Tu+v=f 

Starting  with  A  =  Ao  in  (2.1a), 

(2.2a)  [uo,v0]  =  arginf  QT{f,  A0) 

Tu+v=f 

we  proceed,  by  iterating  at  the  dyadic  scales  X3  :=  Ao2J 

(2.2b)  [uj+ 1,  vj+i]  =  arg  inf  Q(vj,  Xj+1),  X3  :=  A02 \j  =  0, 1, . .  .  . 

Tuj+i+Vj+i=Vj 

Thus,  we  have  Vj  =  Tu3+\  +  v3+\  where  v-\  :=  /.  Summing  the  last  recursive  relation,  we  end 
up  with  hierarchical  representation  of  the  blurred  image  / 

(2.3)  /  =  Tw0  +  Tui  +  ...  +  Tuk-i  +Tuk  +  vk , 
which  in  turn  paves  the  way  for  hierarchical,  multiscale  denoised  expansion 

m 

(2.4)  "  ~  J2  "T 

3=0 

We  note  that  the  last  expansion  needs  to  be  truncated  at  appropriately  chosen  finite  m  in 
order  to  avoid  the  ill-posedness  which  must  occur  as  we  accumulate  infinitely  many  terms, 
approaching  the  ’’inversion”  of  the  ill-conditioned  T. 


2.1.  Hierarchical  decomposition  using  <2r-minimizers.  To  study  the  hierarchical  expan¬ 
sions  (2.4),  we  first  characterize  the  minimizers  of  the  Q^-functionals  (2.1).  The  characteriza¬ 
tion  summarized  in  theorem  below  extends  Meyer’s  result  [Me02,  Theorem  4]  (and  we  also  refer 
to  [ACM04,  Chapterl]  for  related  characterization  of  minimizers  involving  dual  functionals). 

We  recall  that  the  regularizing  functional  ||/||  in  (2.1b)  is  a  semi-norm  and  we  define  its  dual 
w.r.t  the  L2(Q)  scalar  product  (•,  •), 


(2.5) 


:=  sup 

IWMo 


(f,h) 


so  that  the  usual  duality  holds 


(2.6) 


</,  *}  <M  ll/ll. 


We  say  that  (/,  h )  is  an  extremal  pair  if  equality  holds  above.  The  theorem  below  characterizes 
u  as  minimizer  of  the  Q^-functional  if  and  only  if  u  and  T*(f  —  Tu)  form  an  extremal  pair. 


Theorem  2.1.  Let  T  :  T2(fl)  — ■»  T2(fl)  be  a  linear  continuous  blurring  operator  with  adjoint 
T*  and  let  Qt  denote  the  associated  functional  (2.1a). 

(i)  The  variational  problem  (2.1)  admits  a  minimizer  u.  Moreover,  if  ||  •  ||  is  strictly  convex, 
then  a  minimizer  u  with  ||w||  ^  0  is  unique. 

(ii)  u  is  a  minimizer  of  (2.1)  if  and  only  if 


(u,T*(f-Tu))  =  \\u\\-\\T*f-T*Tu\U 


u 


2A  ' 


(2.7) 
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The  detailed  proof  of  the  theorem,  whose  second  part  was  sketched  in  [Me02]),  is  postponed 
to  the  end  of  this  section.  The  next  two  remarks  lead  to  refinement  of  theorem  2.1,  depending 
on  the  size  of  ||T*/||*. 

Remark  2.1.  [The  trivial  minimizer].  More  can  be  said  in  case  /  consists  mostly  of  texture, 
in  the  sense  that 

(2.8)  IIT7II.  <  T. 

Indeed,  if  (2.8)  holds,  then  the  characterization  of  the  minimizer  u  in  (2.7)  implies 

hd  =  («., TV)  -  (u,T-Tu)  <  M  -  ||T«.|||S, 

and  hence  Tu  =  0.  But  then  Qr(f,  A)  =  ||w||  +  A||/|||2  implies  that  u  =  0  is  a  minimizer  of 
(2.1),  with  Qr(f,  A)  =  A||/|||2.  The  converse  of  this  assertion  also  holds.  We  summarize  with 
the  following  corollary. 

Corollary  2.2.  [The  case  ||T*/||*  <  1  / 2A /.  Let  T  :  L2(Ll)  — >  L2(Ll)  be  a  linear  continuous 
blurring  operator  with  adjoint  T*  and  let  Qt  denote  the  associated  functional  (2.1a).  Then 
||T*/||*  <2 \  if  and  only  if  u  =  0  is  a  minimizer  of  (2.1). 

Proof.  Assume  ||T*/||*  <  1/2A.  We  have  already  seen  that  u  =  0  is  a  minimizer.  One  can  also 
argue  directly  that  since  2A (T*f,  h )  <  ||h||  for  all  h  G  BV(Q),  then 

IWI  +  A||/  -  Th Hi,,,,  =  ||/i||  +  A||/||=a(n)  -  2A(/,  Th)  +  A||77t||^(n) 

=  llftll  -  2A(T7,  h)  +  A||/|||J(n)  +  A||Tft|||a(0) 

>  A||/|||2(n)  +  A||T/r|||2(n)  >  A|| /  -  T0\\2L2^  +  ||0||, 

and  therefore  u  =  0  is  a  minimizer  of  (2.1a).  It  remains  to  verify  the  ,:if”  part,  namely,  if  u  =  0 
is  a  minimizer  of  (2.1),  then  for  all  h  G  BV{Tl)  we  have, 

(2-9)  A||/|| 

L2( fl)  ^  M\Th-f\\ 

L2(  fl)  +  Ill'll) 

or 

2X(f,Th)<X\\Th\\2L2{n)  +  \\h\\. 

Rescaling  h  — >  eh ,  we  obtain 

2Xe(f,Th)<Xe2\\Th\\l2{n)  +  e\\h\\. 

Dividing  by  e  and  letting  e  — >  0+,  yields  2A (T*f,  h)  =  2A (/,  Th)  <  ||/i||  for  all  h  G  BV (LI)  and 
we  conclude  ||T*/||*  <  1/2A.  □ 

Remark  2.2.  [Equivalence  classes].  Consider  the  p-order  semi-norm  in  (2.1b),  ||w||  =  ||m||  := 
Jn(j)(Dpu )  and  assume 

ir/u*  <  oo. 

We  note  that  ||  ■  ||*  =  (||  •  ||  )*  should  be  considered  on  the  complement  of  appropriate  equiv¬ 
alence  classes  of  “modulo  polynomials  of  degree  p”.  Indeed,  since  ||h  +  P||p  =  ||/i||  for  any 
polynomial  P  =  P(x)  of  degree  <  p  —  1,  we  have  for  arbitrary  constant  c, 

(. f,h  +  cP )  (/,  h)  +  (/,  cP)  ( f,h >  (f,P) 

\\h  +  cP\\  \\h\\  ||h||  +C  ||h||  • 
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Thus,  ||T*/||*  <  cx),  implies  (T*f,  P)  =  0  for  all  deg  P  <  p  —  1 . 

In  particular,  if  we  assume  that 

T  <  ||T-/||,  <  oo, 

then  a  minimizer  of  Qr(f)  does  not  vanish,  ||u||  ^  0.  Otherwise,  if  ||u||  =  0  then  u  is  a 
polynomial  of  degree  <  p  —  1;  but  by  the  preceding  argument,  the  polynomial  u  should  be 
orthogonal  to  T*f  and  hence 

Qt(/,  A)  =  A||/  -  Tu |||s  =  A(||/|||a  +  \\Tu\\l,), 

which  is  minimized  when  Tu  =  0.  Given  that  ||w||  =  Tu  =  0,  one  can  follow  the  proof  of 
corollary  2.2,  starting  with  (2.9)  and  concluding  that  ||T*/||*  <  1/2A,  which  contradicts  our 
assumption.  We  can  summarize  this  case  in  the  following  corollary. 

Corollary  2.3.  [The  case  ||T*/||*  >  1  / 2A /.  Let  T  :  L2(Q)  — >  L2(Q)  be  a  linear  continuous 
blurring  operator  with  adjoint  T*  and  let  Qt  denote  the  associated  functional  (2.1a)  with  ||  ■  ||  = 
||  •  ||p.  Assume  that 

T  <  ||T*/||,  <  oo. 

Then  u  is  a  minimizer  of  (2.1)  if  and  only  if  u  and  T*(f  —  Tu)  is  an  extremal  pair  and 
(2.10)  \\T*f -T*Tu\\*  = 

Moreover,  if  ||  •  ||  is  strictly  convex  then  the  minimizer  u  is  unique. 

Proof.  We  can  now  divide  the  equality  on  the  right  of  (2.7)  by  ||u||  =  ||u||p  ^  0.  Moreover,  since 
||T*w||*  >  1/2A  then  by  remark  2.2,  ||tt||  ^  0  and  uniqueness  follows  from  theorem  2.1  (i) .  □ 


Equipped  with  theorem  2.1,  we  can  extend  the  (BV,  L2)-hierarchical  decompositions  intro¬ 
duced  in  TNV  to  general  QT-functionals. 

Theorem  2.4. 

(i)  [Hierarchical  expansion].  Let  f  e  L2(f2)  and  consider  the  dyadically -based  Qt  decomposition 
(2.2).  Then  f  admits  the  following  hierarchical  expansion 

OO 

(2.11a)  /= 

j= o 

here,  the  a  should  be  interpreted  as  the  convergence,  —a  /  in  the  weak  ||  •  ||  -sense, 

(2.11b)  im/-HEr“i)ll*  =  iiE+r- 

3=0  0 

(ii)  [Energy  decomposition].  The  following  energy  estimate  holds 

oo  1 

Y.  +  \\Tuj\\h(Q) 

3=0  J 


(2.12a) 


<  Wf\\h(np  A,  :=  A02T 
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Moreover,  if  f  G  BV(Q)  then  equality  holds  in  (2.12a), 

oo  2 

(2.12b)  E  [ylMI  +  HTvllh«>]  =  H/lliw  /  e  BV((l). 

3=0  j 

We  note  in  passing  that  the  BV  regularity  assumption  can  be  relaxed  for  the  energy  decompo¬ 
sition,  (2.12b),  to  hold;  consult  [TNV04,  Corollary  2.3]. 

Proof.  If  ||T*/||*  <  1/2A  then  by  corollary  2.2,  the  minimizer  of  (2.1a),  [u\,V\\  =  [0 ,/];  other¬ 
wise 

(2-13)  \\T*vx\\*  =  (Tux,vx)  =  ^||«A||. 

The  first  statement  (2.11a)  then  follows  from  the  basic  hierarchical  expansion,  /  =  (V)]]  Tuj  + 
Vk  while  noting  that  ||T*'Ufc||*  =  l/2Afc.  For  the  second  statement,  (2.12),  we  begin  by  squaring 
the  basic  refinement  step,  Tuj+ 1  +  Vj+ \  =  Vj, 

(2.14)  \\vj+i\\l2(n)  +  ll^j+illi^n)  +  2(Tuj+i,Vj+i)  =  ||'tb||l2(np  j  =  —1,0, 1, . . .  . 

Observe  that  the  last  equality  holds  for  j  =  —1  with  v-\  interpreted  as  V-\  :=  /.  We  recall 
that  [uj+i,Vj+i]  is  a  minimizing  pair  for  Qr(vj,  Aj+i)  and  hence,  by  (2.13), 

2(Tuj+l,vj+l)  =  — -  ll^j+i  II, 

Ai+i 

yiekling  ^-||ui+1||  +  \\Tuj+1\\2L2{n)  =  |K^|||2(n)  -  \\vj+i\\2L2{ny  We  sum  up  obtaining  (2.12a) 

Y  ["IK II  +  =  Y,  — llwl+i II  +  ll^i+illi2^)  = 

3=0  j  j=- 1  j+1 

=  lh;-illL2(n)  —  IKk'||i2(n)  =  ll/lli2(n)  —  ll^fclli2^)  —  ll/lli2(n)- 

Given  that  /  has  BV  regularity,  one  can  follow  the  argument  in  [TNV04,  Theorem  2.2]  to 
conclude  the  equality  (2.12b).  □ 

We  conclude  this  section  with  the  promised 

Proof,  of  theorem  2.1. 

(i)  The  existence  of  a  minimizer  for  the  Q^-functional  follows  from  standard  arguments  which 
we  omit,  consult  e.g.,  [Jo07,  Section  8.6].  We  address  the  issue  of  uniqueness.  Assume  v.\  and 
U2  are  minimizers 

|| Ui  ||  T  A  ||  /  TWj||L2  jmin ,  i  1,2 

then  by  standard  line  of  argument  we  consider  the  average  u%  :=  [u\  +  uf)/‘2.  to  find 

jmin  <  \\U3\\  + X\\f  -  Tu3\\2l2 

—  2  (ll^1  II  +  M\f  —  ^llll2  +  II^H  +  A ||/  —  Tm2||12)  —  -^\\T(ui  —  M2)||l2 
1 

E  jmin  —  ^2)  \\ L2' 
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Thus,  u\  —  U2  belongs  to  the  kernel  of  T.  We  then  end  np  with  the  one-parameter  family  of 
minimizers,  uq  U\  +  9{u2  —  «i),  9  £  [0, 1], 

jmin  —  \\uo\\+M\f-Tue\\h 

<  0\\u2\\  +  (1  -  0)|M|  +  9\\\f  -  TU2WI2  +  (1  -  6>)A||/  -  Tu, Ilia  =  jmin. 

Clearly,  the  two  minimizers  satisfy  ||«i||  =  ||w2||  and  we  conclude  that  the  ball  ||u||  =  ||«i||  7^  0 
contains  the  segment  {ug,  9  £  [0, 1]},  which  by  strict  convexity,  must  be  the  trivial  segment, 
he.,  u2  =  ui. 

(ii)  If  u  is  a  minimizer  of  (2.1a),  namely,  if  for  any  h  £  BV(Q)  we  have 

M\f  ~  T(u  +  e^)ll|2(n)  +  \\u  +  eh\\  >  A|| /  —  Tu\\2L2^  +  \\u\\% 

then 

(2.15)  Ae2||T/r|||2(n)  —  2A e(Th,  f  —  Tu)  +  \\u  +  eh\\  >  ||u||. 

Since  ||  •  ||  is  sublinear,  the  last  inequality  yields 

Ae2||T/r|||2(n)  -  2A e(Th,  f  —  Tu)  +  ||u||  +  |e|||^||  >  \\u\\, 
or,  after  division  by  e  >  0, 

||ft||+Ae||Tft|||a(0)>2A{Tft,/-Ti,}. 

Letting  e  j  0+,  we  obtain  \\h\\  >  2A (Th,  f  —  Tu)  for  any  h  £  BV{Tt)  and  hence 


/oiun  1  ^  _  (h’T  f~Tu  I, W  |, 

(2.16)  —  >  snp  - — - —  \\T  f  —  T  Tu\\*. 

ZA  \M^o  ll^ll 

To  confirm  (2.7)  it  remains  verify  the  reverse  inequality  in  (2.16).  To  this  end  we  set  h  =  u 
and  —  1  <  e  <  0  in  (2.15),  yielding 

Ae2||Tu||22(r2)  +  (1  +  e)|MI  >  IMI  +  2Ae(u,  T*(f  —  Tu)), 

or 

Ae2||Tw||22(n)  +  e||u||  >  2A e(u,  T*(f  -  Tu)). 

Dividing  by  e  and  letting  e  j  0_,  we  obtain  ^||m||  <  (u,  T*(f  —  Tu)).  This,  together  with  (2.16) 
implies, 

^IMI  <  (u,T*(f  —  Tu))  <  ||«||||T7-T*r«||,  <  T||„||. 

so  that  the  last  inequalities  become  equalities  and  (2.7)  follows. 

Conversely,  we  show  that  if  u  satisfies  (2.7)  then  it  is  the  desired  minimizer.  To  this  end,  we 
rewrite 


11/  -  T(n  +  Z>)||2„(n)  =  ((/  -  Tu)  -  Th,  f  -  T(u  +  ft)) 

=  </  -  Tu,  f  +  T(u  +  ft))  -  2 (/  -  Tu,  T(u  +  ft))  -  (Th,  f-Tu)  +  ||Tft||2S(sl) 

_ #1 _  #2 

=  \\f~Tu\\lHn)  -  2{f  -  TU,T(U+  ft)) +2^x7^71)+||Tft|||2(n). 
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Now,  assumption  (2.7),  || T*(f  —  Tu) ||*  =  implies  2A(#1)  <  || u  +  h\\  and  2A(#2)  =  ||w||. 
We  conclude  that  for  any  h  e  BV( ff), 

||u  +  h\\  +  A||  /  —  T(u  +  h)|||2(n) 

=  ||w  +  h\\  —  2A(#1)  +  2A(#2)  +  A||/  —  Ww|| ^2(^2)  +  A||T/i|||2(r2)  >  ||w||  +  A|| /  —  r-u|||2(n). 

Thus,  u  is  a  minimizer  of  (2.1).  □ 

Remark  that  a  lack  of  uniqueness  is  demonstrated  in  an  example  of  [Me02,  pp.  40],  using 
the  £°°-unit  ball,  which  in  turn  lacks  strict  convexity.  Thus,  strict  convexity  is  necessary  and 
sufficient  for  uniqueness. 


2.2.  Discretization  of  Euler-Lagrange  and  numerical  results.  We  consider  for  illustra¬ 
tion  the  case  of  the  total  variation  [R094],  therefore  ||w||  =  fQ  \Du\.  In  practice,  we  simplify 
the  formulation  by  working  only  on  W1,x{ fl)  and  we  write  ||u||  =  fQ  \Vu\dxdy.  In  order  to 
construct  the  hierarchical  decomposition  of  /,  we  use  the  associated  Euler-Lagrange  equation 
of  Q(f,  A) 

T'Tu>  =  T-f  +  ±  div  (ALA). 

When  working  on  a  bounded  domain  fl,  we  augment  the  Euler-Lagrange  equations  by  the 
following  Neumann  boundary  condition: 


dux 

dn 


on 


0. 


The  hierarchical  decomposition,  /  ~  Yl^oTuj  =  T  Y^;j=o  uj>  is  obtained.  Note  that  we  are 
really  interested  in  the  deblurred  image  u  =  Yl!j=ouji  from  which  the  u/s  are  constructed  as 
(approximate)  solutions  of  the  recursive  relation  governed  by  the  following  PDE: 


T*Vj 

-L  ^ 

2  A j  V  Vuj 

We  implement  our  algorithm  for  this  type  of  image  in  essentially  the  same  way  as  for  the 
case  without  blurring  (see  [TNV04]).  The  only  difference  is  that  we  have  to  deal  with  the 
blurring  operator  T,  a  Gaussian  kernel  in  our  experiments,  and  in  this  we  follow  the  method  of 
discretization  in  [AV97]  and  [VeOl].  The  first  step  is  to  remove  the  singularity  when  |V«a|  =  0, 
by  replacing  Qr(f,  A)  with 


T*Tuj+1  - 


2A, 


div  (T!A±l) 

V  V'lto-4-1  / 


QeAf,  A  ■=  jnf  ,  {  [  Ve2  +  l^u\2dxdy  +  A|| /  -  Tu|||2(n)|. 

We  find  the  minimizer,  u\  =  u\>e  of  the  regularized  functional  associated  with  QeT)  at  each  step 
of  our  hierarchical  decomposition.  The  associated  Euler-Lagrange  equations  are 

(2.17a)  T*Tu\  =  T*f  +  ^~  div  (  /  - )  in  fi, 

2A  V  v/e2  +  |VuA|2>' 


dux 

dn 


(2.17b) 


0  on  dfl, 
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that  we  solve  by  a  dynamic  gradient  descent  scheme  (x,  y,t)  i— >  u(x,  y,t ), 

(2.18) 

Trr  +  T*Tu\  =  T*  f  +  div  (  =)  infix  [0,+oo),  u(x,  j/,  0)  =  /(x,  y)  in  fi. 

at  \  yje1  +  |  VnAf7 

As  in  TNV,  we  use  a  computational  grid,  (x*  :=  ih,  y3  :=  jh ,  tn  :=  nAt),  to  cover  the 
domain  fi  for  t  >  0,  where  h  is  the  cell  size.  Let  =  D+(h),  D _  =  D_{h)  and  .Do  := 
(_D+  +  D_)/ 2  denote  the  usual  forward,  backward  and  centered  divided  difference.  As  an 
example  of  differencing  in  the  x-direction,  D+Uij  =  (uj+iy  —  Uij)/h. 

We  discretize  (2.18)  as  follows 


u”!1  —  • 

ui _ rF*rrr).n  _ 

At  « 


fi  i  +  —  Dx 
i  J  2A  “  L 


— d9  - 
2A  “L 


«+ij  -  <j'1)M 

y62  +  (%?j)2  +  (W 

«j+l  -Wij1)/^  1 


U2  +  (fi+n-j)2  +  (Zlrf.-u-j)2 


Following  [AV97,  VeOl],  we  will  work  with  convolution-type  T’s  which  are  realized  by  sym¬ 
metric  matrices,  {Caf3)a^= M, 

d  d 

71/ ^  y  .  ^  ^  CafjUi-\-clj2—a,j+d/2—d:  ^  ^  Cay  1. 


Since  T  is  assumed  to  be  symmetric,  T*Tu  is  approximated  by 


d  cL 

7  C  i.j  ^  ^  ^  CaffC^Stli-\-d—a—"/,j+d—0—S- 

a, /3=  1  7, <5=1 

To  implement  our  decomposition,  either  a  fixed  point  Jacobi  or  Gauss-Seidel  iterative  method 
can  be  used  to  solve  the  discrete  regularized  Euler-Lagrange  equations  above.  Introducing  the 
notations: 


(2.19a) 

(2.19b) 

(2.19c) 

(2.19d) 
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we  have 

+  2At\h2T*Tu™j  +  A  +  cw «,)  +  cs«,-)  +  cjvKj))^1 

=  ulj  +  At  (cE(u"j)<+ij  +  +  cs{u?j)u?J+1  +  +  2A h2T*fi^ . 


By  using  the  most  recent  values  of  the  UiJ s,  we  implement  the  Gauss-Seidel  scheme. 

In  Figure  2.1,  we  show  a  test  image,  its  blurry  version  (with  Gaussian  blur,  no  noise), 
the  results  obtained  using  the  Rudin-Osher  model  [R094],  and  the  results  obtained  using  the 
hierarchical  model.  The  proposed  hierarchical  model  gives  improved  results  over  the  standard 
RO  model,  in  terms  of  the  root  mean  square  error, 


rmse 


y  h  .;  (^orio.t.i  U restored, i,j 

Eid 


2 


Similarly  Figure  2.2  illustrates  how  the  hierarchical  decomposition  works  for  noisy  blurred 
images,  again  as  an  improvement  over  the  Rudin-Osher  model. 


3.  The  hierarchical  ( SBV,L 2)  decomposition 

We  want  to  construct  the  hierarchical  decomposition  based  on  the  Mumford-Shah  functional 
[MS89].  To  this  end  we  consider  its  elliptic  approximation  of  Ambrosio  and  Tortorclli  [AT92], 


ATp(f,X):=  inf 

{u,v,w  |  u-\-v=j } 


/  (w2  + pep)\Vu\2dx  + p\\Vw\\2L2{Q)  + 


\w  — 


I  L2(0) 


4  P 


+  A  v 


L2(f!) 


where  ep  — >  0  as  p  [  0  and  A,  /i  are  positive  weight  parameters. 


Remark  3.1.  Note  that  we  modified  the  AT), -functional,  where  the  square-root  first-term  on 
the  right  is  replacing  the  original  term,  /^(w2  +  pep)|  Vu\2dx,  appearing  in  Ambrosio- Tortorelli 
work  [AT92],  Our  modified  AT^-functional  does  not  affect  the  main  properties  of  the  seg¬ 
mentation  model,  however;  it  is  introduced  here  in  order  to  enable  the  characterization  of 
AT^-minimizers  in  section  3.1  below.  Our  numerical  calculations  will  then  utilize  the  original 
formulation  AT^-functional . 

Let  [waWa]  be  the  minimize!'  of  ATp(f,  A)  (depending  on  w).  Here  /  G  L°°(Q)  and  U\  is 
restricted  to  the  smaller  SBV  space  ( —  a  special  subclass  of  BV  space,  consisting  of  measure 
gradients  free  of  the  Cantor  component,  [AT92] ) ,  while  the  texture  v\  lives  in  L2.  We  proceed  to 
construct  the  hierarchical  ( SBV,L 2)  decomposition  of  /  in  the  same  manner  as  before,  letting 
[?iJ+i ,  Uj+i]  be  the  AT  minimizer 


[uj+i,vj+i]  =  arg  inf  ATp(vj,  Xj),  \j  =  A02L 

U,V,W,lL+V=Vj 

We  end  np  with  the  hierarchical  decomposition 

/  =  u0  +  U1  +  •••  +  uk  +  Tfc. 

Here,  at  each  hierarchical  step,  we  also  obtain  the  edge  detectors  1  —  w j  —  1  —  w\j7  which  are 
(essentially)  supported  along  the  boundaries  of  objects  enclosed  by  edges  identified  by  Uj. 
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Figure  2.1:  1st  row,  from  left  to  right:  original  test  image,  its  blurry  version  /,  and  Rudin- 
Osher  restoration  uro ,  vro  =  /  —  uro  +  128,  rmse=0.1066.  RO  parameters:  A  =  2000,  h  =  1, 
At  =  0.1.  2nd  to  last  rows,  left  to  right:  hierarchical  recovery  from  the  same  blurry  initial 
image  /  using  k  —  19  steps,  shown  every  other  one,  and  residual  at  step  19.  Parameters: 
Aq  =  1,  At  =  0.1,  h  =  1,  and  A&  =  2fcAo-  Final  root  mean  square  error,  rmse=  0.0922. 


3.1.  Characterization  of  ( SBV ,  L2)-minimizers.  We  proceed  along  the  lines  of  our  analysis 
of  general  Q-functionals  in  section  2.1.  We  begin  with  a  general  characterization  of  ATp- 
minimizers  as  extremal  pairs.  To  this  end,  we  introduce  the  weighted  spaces  for  given  w  G 
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Figure  2.2:  1st  row,  from  left  to  right:  blurry-noisy  version  /,  and  Rudin-Osher  restoration 
uro,  v ro  =  f  —  uro  +  128,  rinse  =0.2028.  RO  parameters  A  =  0.5,  h  =  1,  A t  —  0.025.  The 
other  rows,  left  to  right:  the  hierarchical  recovery  of  u  from  the  same  blurry-noisy  initial  image 
/  using  6  steps.  Parameters:  Ao  =  0.02,  At  =  0.025,  h  =  1,  and  A*,  =  2fcAo,  rmse=  0.2011. 

\h\ Hi(n)  :=  J l^(w2  +  pep)\Vh\2dx, 

and  we  let 


H/ll/zyRn)  suPheHt,(n){f ,  h)/\h]Hi^ 

denote  the  dual  norm.  We  have  now  the  following  characterization  of  the  minimizers  -u,  w  of 
the  .4.7^-energy. 

Theorem  3.1.  Ifu,w  €  [0,1]  are  minimizers  of  the  ATp-energy,  then 


(3.1) 


11/  “llr/ypn) 


_h_ 

2A’ 


R  i  | 

-  2^lwl fl-i(n)- 


and  (/  —  u,  u) 
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Proof.  Let  [u,  w]  be  a  minimizing  pair.  Considering  the  variation  of  ATP  only  with  respect  to 
u,  we  find  that  for  any  h  G  i/1(h2),  we  have 

+  A||  /  -  if||!2(n)  <  n\u  +  eh\Hi(n)  +  A||  /  -u-  eh\\2L2{n). 

The  triangle  inequality  yields  the  “first  variation”  (or  more  precisely,  sub-differential) 

(3-2)  2A e{f  —  u,  h)  <  Ae2||/i|||2(Q)  +  pe\h\Hi^)- 

For  e  >  0  this  gives  2A (/  —  u,  h)  <  Ae||/i|||2^  +  and  as  e  ^  0+,  we  deduce  that  for 

all  h  G 

(f  ~  u,  h)  p_ 

\h\Hi(n)  ~  2A’ 
or 

(3-3)  11/  —  u\\hP(Q)  —  ifff- 

Now,  if  we  set  h  —  u  in  (3.2),  we  find 

2A e(f  —  u,  u)  <  Ae2||u||22(Q)  +  p,e\u\Hi^y 
Again,  hrst  dividing  by  e  <  0  and  let  e  |  0_,  we  obtain 
(3-4)  (f~u,u)>^\u\Hi{Q). 

Combining  (3.3)  and  (3.4)  we  find, 

<  {f  ~u,  u)  <  \\f  -  uWh^^WIhU^)  ^ 

confirming  that  the  last  inequalities  are  in  fact  equalities  and  thus  concluding  the  proof.  □ 


As  before,  consult  corollary  2.2,  the  fact  that  the  image  /  contains  too  much  texture  is  linked 
to  a  trvivial  A'7))-niinimizer.  One  part  of  this  link  is  the  content  of  the  following  theorem. 

Theorem  3.2.  If  u  =  0  and  w  =  1  are  minimizers  of  the  ATp-energy,  then 

(3.5)  H/iih-w  < 

Proof.  If  \u,  w]  =  [0, 1]  is  a  A^-minimizer  then  for  any  h  G  i/1(h2),  that 

A||/||  i2(n)  A  eh  J  J^(l  +  pep)\Vh\2dx  +  A|| /  -  e/r|||2(n), 
or,  after  expanding  terms, 

2eA (/,  h)  <  e2A||h||22(r2)  +  +  pep)\Vh]2dx. 

As  e  |  0+,  we  deduce  that 


2A(/,  h)  —  CeW  y  (1  +  pep)\X/h\2dx, 


and  (3.5)  follows. 


□ 
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Equipped  with  the  characterization  of  ^47^-minimizers,  we  turn  to  analyze  the  corresponding 
hierarchical  decomposition. 

Theorem  3.3. 

(%) [Hierarchical  decomposition] .  Consider  f  €  L2{fX).  Then  f  admits  the  following  hierarchical 
decomposition 

OO 

(3.6a)  /*X>, 

3=0 

where  =  is  interpreted  as  weak  H -1  -convergence  of  the  residuals 

k 

(3-6b)  11/  _  E^H<(n)  =  \  2fc+1 ' 

Here,  Wk  is  computed  recursively  as  the  weighting  minimizer  of  ATp{f  —  'Y(!j=ouji  Ao2J). 

(ii) [Energy  decomposition].  The  following  ‘energy1  estimate  holds 


Moreover,  if  f  is  sufficiently  smooth  then  equality  holds  in  (3.7). 


Proof.  The  first  statement,  (3.6),  follows  from  the  basic  hierarchical  expansion,  /  =  )Co  u3  +i-’fc, 
while  noting  that  IkH#-1^)  =  p/2\^.  For  the  second  statement,  (3.7),  we  begin  by  squaring 
the  basic  refinement  step,  u]+\  +  Vj+\  =  Vj, 


(3.8)  \\vj+i\\2L2  +  \\uj+i\\2L2  +  2(uj+i,Vj+i)  —  |k|||2,  j  —  — 1,0,1,...  . 

Observe  that  the  last  equality  holds  for  j  =  —1  with  u_i  interpreted  as  u_i  :=  /.  We  recall 
that  [uj+i,Vj+i\  is  a  minimizing  pair  for  ATp (vj,  Aj+i)  and  hence,  by  (3.1), 


2(uj+l,Vj+l)  -  ——  | Uj+i  | ifi  (12) , 

Ai+i  3+ 

yiekling  ^\Uj+1\Hi^  («)  +  hj+Alh  =  \\vj |||2  -  \\vj+i\\2L2.  We  sum  up  obtaining 


'”3+ 1 


7=0  J 


fc-1 


I U3  I  Hi,  (12)  +  IMIl2 


E  +  llMi+1lli2 


3=~  1 


=  Ik-illi*  -  Iklli,  =  ll/lll,  -  llufcllia  <  n/iil. 


□ 


3.2.  Discretization  of  Euler-Lagrange  and  numerical  results.  We  consider  the  (original) 
Ambrosio-Tortorelli  functional  [AT92]  (neglecting  the  term  pep) 


inf 

{u,v,w  |  u-\-v=f} 


T  /  (w2)\Vu\2dx  +  p||Vw||i2(i2)  +  A - + 

Jn 


I  L2(!2) 
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The  associated  Euler-Lagrange  equations  are 

Xux  -  fi\7(w2xVux)  =  X /, 

1  +4/ip|VuA|2  , 

~Awx  +  — v — 1  Wx  ~ 


1  +4/ip|VuA|2 


=  0. 


We  construct  the  hierarchical  decomposition  in  the  same  manner  as  before,  so  /  rs-/  EjU »./ 
with  the  additional  feature  that  the  accumulated  w/s  give  the  set  of  edges  of  the  image  u. 
Discretization  of  the  Euler-Lagrange  equations  yields 

A fi,j  =  Xuid  -  pDx_ -  pDy_ 


'UJi.  i 


Dx_D\Wij  +  Dy_D\^0 
Using  the  notation 


1  +  AupKDfiuij)2  +  (Dy0u 


ij/ 


4p2 


w 


1  +  4  pp[(D%uitj)2  +  { Dy0Uij )2] 


Ci  \  —  A  +  ^-{2 w2j  +  w2_ ij  + 

C2  :  =  1  +  4m ~  V  +  f  ^’i+1  ~  V  +  16/?2 


we  have 


Ui,j  — 


r 

Ci 

1 


2  h 


XfiJ  T  .  2  (^i,j  (^b+1  J  T  T  VJi_ijUi—ij  T  w\j_iUitj— i) 


2h 


h‘ 2  ’ 


wiJ  = 


Co  L 


/l2 


4p2 

1  +  "P_(U,*+1J  + 


In  order  to  minimize  the  grid  effect,  we  alternate  the  above  scheme  with  the  following  one, 
obtained  by  substituting  D+  for  LL  (and  vice-versa)  in  the  discretization  of  the  above  Euler- 
Lagrange  equation: 

Ci  :  =  A  +  2wC  +  w2+  ij  +  w2j+i) 


D2  :  =  1  +  4/ip 


f  f  'U'iJ+l  ,  16/9 


2h 


+ 


2  h 


+ 


h 2  * 


yielding 


ui,j  ~ 


Xfi,j  T  ,  2  lj  T  V'ip— l)  T  ,/  4* 


A  L 
1 


h2 


4p2 

1  +  +  wi-l,j  +  ^i,j+l  +  1 ) 


In  figures  3.3  and  3.4  we  demonstrate  the  hierarchical  .ALT^-decompositions.  We  can  clearly 
see  that  we  converge  to  the  desired  image  as  well  as  obtaining  a  hierarchical  representation, 
X)  2 ~yWj,  of  the  contours  of  the  image  /. 
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Figure  3.3:  The  sum  of  the  Ui  s  using  the  Ambrosio-Tortorelli  approximation  of  the  image  of  a 
woman,  using  10  steps.  Parameters:  Aq  =  .25,  p  =  5 ,  p  =  .0002,  and  Xk  =  2kX0. 


4.  Hierarchical  decomposition  of  images  with  multiplicative  noise 

Following  [R094],  [RLO03],  we  consider  a  multiplicative  degradation  model  where  we  are 
given  an  image  /  =  u  ■  v,  with  u  >  0  being  the  original  image  and  v  models  the  multiplicative 
noise,  normalized  such  that  Jnv(x,y)dxdy  =  1,  where  for  simplicity,  we  assume  that  1 0 1  =  1. 
Let  U\  be  the  minimizer  of  the  corresponding  total  variation  functional  in  the  multiplicative 
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Figure  3.4:  The  weighted  sum  of  the  Wi  s  using  the  Ambrosio-Tortorclli  approximation  of  the 
image  of  a  woman,  using  10  steps.  Parameters:  Aq  =  .25,  n  =  5,  p  =  .0002,  and  A &  =  2fcAo- 


case  [R094],  [CL95]  (in  a  simplified  form,  without  a  mean  constraint), 


(4.1) 


M(f,  A;  BV,  L2)  :=  inf  (a 

V  '  u£BV+(n)  l 


f  1 1 2 
-  -  1 


u 


L2(  fl) 


+  \U 


If  /  >  0  a.e.  in  fl,  then  (4.1)  has  at  least  a  minimizer  u  >  0  [CL95]. 

Setting  v\  :=  we  end  up  with  the  one  scale  decomposition  /  =  U\V\.  We  construct 
the  hierarchical  decomposition  as  in  TNV,  except  that  sums  and  differences  are  replaced  by 
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Figure  3.5:  The  sum  of  the  Ui  s  using  the  Ambrosio-Tortorelli  approximation  on  the  image  of 
a  fingerprint.  Parameters:  n  =  5,  p  =  .0002,  A0  =  .25,  k  =  10,  and  A&  =  2fcAo- 
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Figure  3.6:  The  sum  of  the  Wi  s  using  the  Ambrosio-Tortorelli  approximation  on  the  image  of 
a  fingerprint.  Parameters:  n  =  5,  p  =  .0002,  A0  =  .25,  k  =  10,  and  A&  =  2fcAo- 
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products  and  quotients.  Thus,  the  iterative  step  at  scale  A j  =  Ao2J  reads,  Vj  =  Uj+iVj+i,  leading 
to  the  multiplicative  hierarchical  decomposition 

f  =  u0u  1...ukxvk,  \j  =  A02J. 


4.1.  Characterization  of  Al-minimizers.  We  begin  with  characterization  of  the  A !(/,  A;  BV,  L2)- 
minimizers.  We  show  that  [waWa]  is  a  minimizer  if  it  is  an  extremal  pair,  properly  interpreted 
in  terms  of  the  dual  BV  norm  ||  •  ||*  (consult  [Me02,  Definition  10]). 


Theorem  4.1.  If  u  is  a  minimizer  of  (f-l)  then 

M  BpS)) 


(4.2) 

Proof.  Let 

(4.3) 


M  BV(fl) 


IP -i 


u 2  \u 


2A 


and 


u*  \u 


9(e)  ■=  ( 


/ 


u  +  eh 


Taylor’s  expansion  gives  g(e)  =  (f  -  l)  '  -  2e({  -  l)  g  (ee)  and  hence 

—  2Ae/—  —  1,  +  A^-  max  \g"(x)\. 

L2(0)  \u  U2  /  2  X 

This  inequality,  together  with  the  fact  that  u  is  an  At -minimizer  satisfies  for  all  h  G  BV(Q), 


A 

f  i 

2 

<  A 

L- 1 

u  +  eh 

L2(0) 

u 

A 


/ 


u 


L2(0) 


+  \u\ bv(vl)  <  A 


/ 


u  +  eh 


L2(0) 


+  |u  +  e/i|sy(n), 


imply  that 
(4.4) 


2Ae(-  -  1,  <  e|/i|Bv(n)  +  A^-max|/(x)|. 

\  u  uz  /  2  x 


2 

Dividing  by  e  and  letting  e  J,  0+  (while  noticing  that  lime^0  \  maxx  \g”(x)  \  =  0),  yield  that  for 
any  h  G  BV{Pl), 


thus 

(4.5) 


r  is 


u2  \u 


-  1 


2A' 


Now  let  h  —  u  in  (4.4).  Then,  dividing  by  e  <  0,  and  letting  e  j  0_,  we  obtain 


(4.6) 


/  If 


~2  --1  A  > 

VW 


Iw(f2) 


2A 


Combining  (4.5)  and  (4.6)  concludes  the  proof. 


□ 


As  before,  theorem  4.1  could  be  refined,  depending  on  the  amount  of  texture  present  in  /. 
For  example,  compared  with  corollary  2.2,  we  have  that  /  consists  mostly  of  texture,  if  and 
only  if  its  Al-minimizer  is  the  trivial  one  which,  in  the  multiplicative  case,  is  given  by  u  =  1. 
The  following  theorem  confirms  one-side  of  this  implication. 

Theorem  4.2.  If  u  =  1  is  a  minimizer  of  (4-1),  then  || /(/  —  1)||*  <  A. 
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Proof.  Since  u  =  1  is  assumed  to  be  .M-minimizer,  we  have  for  any  h  G  BV (Vt) 

f  "2 


A 


1  +  eh 


1 


L2(  Q) 


+  |1  +  eh\Bv(n)  >  ^11/  -  1|Il2(0)- 


Revisiting  g(e)  in  (4.3)  with  u  =  1,  we  have 

/ 


.  1  +  eh 

The  last  two  relations  yield 


0(e)  :=  {y+IK  ~  X)  ~  ^  ~  2e^  ~  1^h  +  \9"^' 


h2 


(4-7)  X\\f  —  l||i2(n)  —  2Xe(h,  /(/  —  1))  +  Ae2  /  —g"(l)dx 

J  Yl 

(4.8)  +A  f  0((eh)3)dx  +  ...  +  e\h\Bv(fi)  >  A||/  —  1||  l2(f 2)- 

Jn 

Divide  by  e  and  let  e  J,  0+,  to  obtain  that  for  all  h  G  BV(Q) 

\h\Bv(n)  >  2A(h,  /(/  —  1)), 

which  means  that  ||/(/  —  1)||*  < 


□ 


4.2.  Discretization  of  Euler-Lagrange  and  numerical  results.  Formally  minimizing  M.  (/,  A) 

with  respect  to  u  yields  the  following  associated  Euler-Lagrange  equation: 


U\ 


f 


u\ 


=  —  div 
2A 


/ 

V 


When  working  on  a  bounded  domain  we  augment  the  Euler-Lagrange  equations  by  the 
following  Neumann  boundary  condition: 


dux 

d n  |9f2 


=  0. 


The  hierarchical  decomposition,  /  r^i  n-=  zQUj,  is  obtained,  in  which  the  ufs  are  constructed 
as  (approximate)  solutions  of  the  recursive  relation  governed  by  the  Euler-Lagrange  equation. 

To  discretize  the  Euler-Lagrange  equation,  we  begin  by  regularization  of  Ai(f,  A)  to  avoid 
the  singularity  when  |V«\|  —  0.  So,  we  have 


A)  :=  inf  { A 

u  ’  u&BV  l 


f  1 1 2 
- —  1 


u 


L2(  fi) 


+ 


e2  + 


This  yields  the  associated  Euler-Lagrange  equations: 

f2  ,  /  1  (  Vu 


(4.9) 


-4  +  4  =  4  divf-  _ „ 

ma  u\  2A  V  ^/e2  +  |  V«a|2^ 


that  we  solve  by  a  dynamic  scheme  (x,  y,t)  h- ►  u(x,  y,t ): 

Vm 


(4.10) 


ft*  =  11  _  L  m  J_Hiv 

dt  u 3  u2  2AC1VVv/e2  +  |Vm|27’ 


«(®,j/,o)  =  /(+  y)- 
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Figure  4.7:  The  recovery  of  u  given  an  initial  image  of  a  woman  with  multiplicative  noise,  for 
10  steps.  Parameters:  Aq  =  .02,  and  A j.  =  2k\0. 


Let  uf3  ~  u(xi,yj,nAt).  The  discretization  that  we  have  used  is  a  linearized  semi-implicit 
scheme: 


un+l  _  un 

At 


A. 

Jh3 


/, 


h3 


(U 


n  ^3 


(U 


n  \  2 


2A  h2 
1 

2A/^ 


(cSu”+ij  +  CwK_  1J  +  cs-u'j+1  +  CNUp_p 


n+1 


(ce  +  Cw  +  C5  +  CjvKj  , 


Multiscale  hierarchical  decomposition  of  images 


25 


,n+l 


or,  solving  for  u'-j  , 


u 


n+l 


1  +  2 w(Ce  Cw  +  CS  +  CN ) 


fi 


u™,  +  At 
.  l’J  (u 


h3 


n  \3 


-  At- 


/, 


'i,j  > 


(U 


n  \2 

%j 1 


’2A^(CE^+1J  +  +  CsWiJ+i  +  CjvU"j-i) 


where  the  constants  ce,  cw,  cs  and  cn  are  the  same  as  before,  (2.19). 

We  note  in  passing  the  issue  of  stability :  in  order  to  enable  the  necessary  division  by  u  ^  0, 
we  shift  /  away  from  zero,  adding  a  positive  constant  which  is  subtracted  from  the  final  result. 

We  demonstrate  our  hierarchical  decomposition  to  the  image  /  in  figure  4.7.  We  can  see  that 
just  as  in  the  case  with  additive  noise,  we  must  pay  a  price  for  the  recovered  texture,  namely 
the  return  of  some  noise.  As  in  the  case  with  additive  noise,  using  a  finer  decomposition  might 
give  improved  results. 
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